Ensemble slice sampling
نویسندگان
چکیده
Slice Sampling has emerged as a powerful Markov Chain Monte Carlo algorithm that adapts to the characteristics of target distribution with minimal hand-tuning. However, Sampling's performance is highly sensitive user-specified initial length scale hyperparameter and method generally struggles poorly scaled or strongly correlated distributions. This paper introduces Ensemble (ESS), new class algorithms bypasses such difficulties by adaptively tuning utilising an ensemble parallel walkers in order efficiently handle strong correlations between parameters. These affine-invariant are trivial construct, require no hand-tuning, can easily be implemented computing environments. Empirical tests show improve efficiency more than magnitude compared conventional MCMC methods on broad range In cases multimodal distributions, sample even high dimensions. We argue parallel, black-box gradient-free nature renders it ideal for use scientific fields physics, astrophysics cosmology which dominated wide variety computationally expensive non-differentiable models.
منابع مشابه
Slice Sampling
Markov chain sampling methods that automatically adapt to characteristics of the distribution being sampled can be constructed by exploiting the principle that one can sample from a distribution by sampling uniformly from the region under the plot of its density function. A Markov chain that converges to this uniform distribution can be constructed by alternating uniform sampling in the vertica...
متن کاملParallel multivariate slice sampling
Slice sampling provides an easily implemented method for constructing a Markov chain Monte Carlo (MCMC) algorithm. However, slice sampling has two major drawbacks: (i) it requires repeated evaluation of likelihoods for each update, which can make it impractical when evaluations are expensive or as the number of evaluations grows (geometrically) with the dimension of the slice sampler, and (ii) ...
متن کاملPseudo-Marginal Slice Sampling
Markov chain Monte Carlo (MCMC) methods asymptotically sample from complex probability distributions. The pseudo-marginal MCMC framework only requires an unbiased estimator of the unnormalized probability distribution function to construct a Markov chain. However, the resulting chains are harder to tune to a target distribution than conventional MCMC, and the types of updates available are limi...
متن کاملSlice sampling mixture models
We propose a more efficient version of the slice sampler for Dirichlet process mixture models described by Walker (Commun. Stat., Simul. Comput. 36:45–54, 2007). This new sampler allows for the fitting of infinite mixture models with a wide-range of prior specifications. To illustrate this flexibility we consider priors defined through infinite sequences of independent positive random variables...
متن کاملCovariance-Adaptive Slice Sampling
We describe two slice sampling methods for taking multivariate steps using the crumb framework. These methods use the gradients at rejected proposals to adapt to the local curvature of the log-density surface, a technique that can produce much better proposals when parameters are highly correlated. We evaluate our methods on four distributions and compare their performance to that of a non-adap...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Statistics and Computing
سال: 2021
ISSN: ['0960-3174', '1573-1375']
DOI: https://doi.org/10.1007/s11222-021-10038-2